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IMAGE PROCESSING METHOD AND IMAGE PROCESSING APPARATUS 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image 
processing method and an image processing apparatus, 
and more particularly to an image processing method and 
an image processing apparatus for performing a 
correction process to image data such as a digital 
photographic image or the like. 
Related Background Art 

In recent years, with the advance of InkJet 
printing technology, a printout image more excellent 
than conventional one can be obtained by using a high- 
pixel digital camera and printing technology such as an 
ink jet printing system. 

However, in case of printing out a digitalized 
photographic image, there are problems to be improved 
in quality of the image to be output. With respect to 
the problems, as one of the cause, it is considered 
that color balance for an entire image is disordered 
due to, e.g., an overexposure state or an underexposure 
state of the image, or a phenomenon so-called "color 
fog". 

For example, in case of performing automatic 
photographing using a camera, since AE (automatic 
exposure) is functioned, if the blue sky is contained 
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in "the most: part of a background, an underexposure 
photographing state of inviting a dark scene is 
provided, thereby resulting in a state that a subject 
is taken in an unexcellent state. 

As an example of a digital camera, since an image 
is taken by a CCD (charge coupled device) camera, a 
color of a wavelength not visible to human eyes is also 
captured as an image. Then, when a signal containing 
that color information is processed as signals R (red), 
G (green) and B (blue) (or R, G and B signals), the 
color not be naturally recognized by the human eyes 
becomes visible color, thereby sometimes resulting in 
an unsuitable color balance- In this case, although a 
process of cutting infrared rays by using a filter is 
performed, this process is not always perfect measures. 
Furthermore, a color correction balance is limited by a 
method of a real-time correction. As a result, a 
perfect process is hard to be performed, and an entire 
color balance is not often perfectly ensured. 

Such disorder in color balance on a taken image 
gives an influence to a print image as a result. 
Therefore, in order to obtain an excellent printed out 
result, it is desirable to correct an input image 
itself, such as a taken image or the like, to an image 
of having suitable color balance. 

As a method of performing this correction, the 
present inventor proposed a method of setting a 



correction condition on the basis of the highest 
brightness or the lowest brightness obtained by 
analyzing a histogram of an image, in Japanese Patent 
Application No. 10-177272 (corresponding to U.S. Patent 
Application Serial No. 09/337,548 filed on June 22, 
1999). 

Incidentally, the following problem other than the 
"color fog" or the color balance disorder depends on 
the exposure is found in quality of an image to be 
printed. 

As described above, with the advance of the Inkjet 
printing technology in recent years, dots formed by ink 
are minimized to level of exceeding a visible limit, 
and printing of "nongranular state" can be realized. 
In this point, the Inkjet printing technology is almost 
equal to printing technology of a silver bromide 
photograph. However, according to a characteristic of 
ink used in the Inkjet printing, there has been 
remained a problem that an absolute density realized in 
a print image is lower than that of the silver bromide 
photograph as shown in Fig. 20. 

It should be noted that this problem is not 
peculiar to the Inkjet printing technology, but the 
similar problem is found in another printing system or 
a display such as a CRT (cathode ray tube) or the like. 
Generally, it has been known that an output image 
becomes clear by properly increasing the density, and 
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an excellent color image properly reproduced can be 
obtained. 

If the density is uniformly increased for the 
purpose of increasing density of an output image, 
5 gradation of a dark part is crushed or broken in an 
image having lots of dark parts. As a result, image 
quality is sometimes deteriorated. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide 
an image processing method and an image processing 
apparatus which can improve quality of an output image 
by properly setting a correction condition in 
accordance with a characteristic of an image. 

In order to achieve the abovementioned object, the 
present invention provides an image processing method 
which sets a correction condition for correcting 
components regarding brightness of image data on the 
basis of a histogram corresponding to the components 
regarding image brightness represented by the image 
data, and corrects the image data according to the set 
correction condition, said method comprising the steps 
of: 

calculating a ratio of the components included 
within a predetermined range in the histogram; and 

setting the correction condition on the basis of 
the calculated ratio. 
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Further, the present invention provides an image 
processing method which discriminates degree of 
lightness of an image on the basis of a histogram 
related to the number of pixels of a component value 
regarding image brightness indicated by image data, 
sets degree of correcting components regarding 
brightness of the image data on the basis of the 
discriminated result, and corrects the components 
according to the set correction degree, said method 
comprising the steps of : 

calculating a component value in the histogram 
wherein a cumulative frequency accumulated from the 
maximum value or the minimum value indicates a 
predetermined value within a range of the component 
value; 

calculating a cumulative frequency accumulated 
from the maximum value or the minimum value to a 
predetermined component value in the histogram; 

discriminating the degree of lightness on the 
basis of the calculated component value and the 
cumulative frequency; and 

setting the correction degree on the basis of the 
discriminated result . 

Another object of the present invention is to 
suppress the crush in the dark part gradation. 

In order to achieve the abovementioned object, an 
image processing method which sets a correction 
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condition for an input image in accordance with a ratio 
of a shadow area in the input image, said method 
comprising the steps of: 

setting first correction condition for the input 
image in accordance with a ratio of a first shadow area 
in the input image; and 

adjusting a correction condition for a shadow area 
of the first correction condition in accordance with a 
ratio of a second shadow area, of which extent is 
different from that of the first shadow area, in the 
input image. 

Other objects and features of the present 
invention will become apparent from the following 
detailed description and the attached drawings* 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the structure of 
a print system according to an embodiment of the 
present invention; 

Fig. 2 is a view showing a process performed in a 
printer driver in the print system; 

Fig. 3 is a view mainly showing the structure in 
converting signals in an automatic gradation correction 
process performed as an image correction process in the 
process performed in the print driver; 

Fig. 4 is a flow chart showing a procedure of the 
automatic gradation correction process; 



Fig. 5 is a view showing a hist:ogram in a case 
where an image to be processed by the automatic 
gradation correction process is a light image; 

Fig. 6 is a view showing a histogram in a case 
where the image to be processed by the automatic 
gradation correction process is a dark image; 

Fig. 7 is a flow chart showing a process procedure 
of a gradation curve Judgement in the automatic 
gradation correction process shown in Fig, 4; 

Fig. 8 is a view showing table content used in the 
gradation curve judgement and explaining a method of 
determining a gamma ( y ) value corresponding to the kind 
of image; 

Fig. 9 is a view showing a conversion 
characteristic curve of a brightness correction table 
corresponding to the gamma value; 

Fig. 10 is a view showing the conversion 
characteristic curve of the brightness correction table 
and explaining a change of a gradation curve for 
maintaining gradation in a low-brightness area. 

Fig. 11 is a view showing a histogram of a typical 
back light image; 

Fig. 12 is a view showing a histogram of 
eliminating influence of the back light in the 
histogram shown in Fig. 11, 

Fig. 13 is a view showing a histogram in a case 
where the image to be processed by the automatic 



gradation correc-tion process is a light image; 

Fig. 14 is a view showing a histogram in a case 
where the image to be processed by the automatic 
gradation correction process is an intermediate 
brightness image ; 

Fig. 15 is a view showing a histogram in a case 
where the image to be processed by the automatic 
gradation correction process is a dark image; 

Fig. 16 is a flow chart showing the process 
procedure of the gradation curve judgement in the 
automatic gradation correction process shown in Fig, 4; 

Fig. 17 is a view showing table content used in 
the gradation curve judgement process and explaining a 
method of determining the gradation curve corresponding 
to the kind of image; 

Fig. 18 is a view showing the conversion 
characteristic curve (exponential function) of the 
brightness correction table corresponding to the gamma 
value; 

Fig. 19 is a view showing the conversion 
characteristic curve (fifth-order curve) of the 
brightness correction table used for performing other 
than merely gamma conversion; and 

Fig. 20 is a view for explaining correction 
content of an embodiment according to the present 
invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[ First; Embodiment: ] 

Fig. 1 is a block diagram schematically showing 
the structure of a print system according to an 
embodiment of the present invention. This system is 
mainly structured by a host computer 100, a printer 106 
and a monitor 105. For example, the Inkjet system 
printer 106 and the monitor 105 are connected to the 
host computer 100 to realize an interactive 
communication . 

The host computer 100 has an OS (operating system) 
102, application software (hereinafter simply called an 
application) 101 such as word processor, spreadsheet 
calculation, an image process, the Internet browser and 
the like, of which each process is performed under a 
control of the OS 102, a printer driver 103 for 
producing print data by processing various drawing 
command groups (image drawing command, text drawing 
command and graphics drawing command ) used for 
displaying an output image issued by the application, 
and a monitor driver 104 for displaying images on the 
monitor 105 by processing the various drawing command 
groups similarly issued by the application 101 as the 
same application as that of the printer driver. 

The host computer 100 has a central processing 
unit (CPU) 108, a hard disk driver (HD) 107, a random 
access memory (RAM) 109, a read only memory (ROM) 110 
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and the like as various hardware capable of being 
operated by the above application. That is, the CPU 
108 performs a signal process concerning the process 
according to the above application, and the various 
applications are previously stored into a hard disk 
driven by the HD 107 and the ROM 110 to be read out if 
needed. The RAM 109 is used as a working area or the 
like for the signal process to be performed by the CPU 
108. 

As the embodiment shown in Fig. 1, the following 
structure can be given. That is, e.g., as an OS, 
Microsoft Windows 98 (TM) is used for a widely used AT- 
compatible personal computer of IBM, to which a monitor 
and a printer are connected and an application capable 
of performing an optional print process is installed. 

In such the print system as above, on the basis of 
an image displayed on the monitor 105 by the 
application 101, a user can produce image data 
constituted by text data classified into text such as 
characters, graphics data classified into graphics such 
as figures, picture data classified into natural images 
and the like similarly through a process according to 
the application. 

When the user instructs a print output of the 
produced image data, the application 101 requests the 
OS 102 to perform the print output and issues the 
drawing command groups indicating an output image 



structured by a graphics data portion as a graphics 
drawing command and a picture data portion as an image 
drawing command to the OS 102. Upon receiving a print 
output command from the application, the OS 102 issues 
the drawing command groups to the printer driver 103 
corresponding to a printer which performs that print 
output . 

The printer driver 103 processes the print output 
command and the drawing command groups input from the 
OS 102 and produces print data having a format capable 
of being printed by the printer 106 to transfer it to 
the printer 106. In this case, if the printer 106 is a 
raster printer, the printer driver 103 sequentially 
performs an image correction process for the drawing 
command from the OS 102 and sequentially rasterizes the 
drawing command to an RGB 24-bit page memory, then the 
content of the RGB 24-bit page memory is converted into 
a data format printable for the printer 106 such as C, 
M, Y and K data after rasterizing all the drawing 
commands, and the converted data is transferred to the 
printer 106. 

Fig. 2 shows a process to be performed by the 
printer driver 103. This process is mainly composed of 
an image correction process and a printer correction 
process . 

An image correction processing unit 120 performs 
the image correction process for color information 
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generated by brightness signals R, G and B included in 
the drawing command groups input from the OS 102. More 
particularly, automatic gradation correction process to 
be described later is performed on the basis of red 
(R), green (G) and blue (B) color information. On the 
other hand, a printer correction processing unit 121 
initially rasterizes the drawing command of the color 
information corrected by the image correction 
processing unit 120, and produces a raster image to the 
RGB 24-bit page memory. Then, cyan (C), magenta (M), 
yellow (Y) and black (K) data which depend on color 
reproducibility of a printer performing printing for 
each predetermined pixel is produced, and the produced 
data is transferred to the printer 106. 

Next, the automatic gradation correction process 
being the process performed by the image correction 
processing unit 120 will be explained. The automatic 
gradation correction process is performed to a picture. 
Therefore, when a graphics image and the picture are 
included in image data, the picture part is extracted 
from the image data and the automatic gradation 
correction process is performed to the extracted 
picture part. 

Fig. 3 is a conceptional vies mainly showing a 
conversion of each signal performed in the automatic 
gradation correction process. Fig. 4 is a flow chart 
showing a process procedure thereof. The automatic 
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gradation correction process in the present embodiment 
is performed by judging brightness of an image to be 
printed using a histogram of summing frequency of each 
brightness value in the image data and determining 
5 degree of a suitable correction (gamma value )- 

Hereinafter, this process will be explained with 
reference to a flow chart shown in Fig. 4. 
(Histogram Summation) 

As shown in Fig. 4, first, in a histogram 

^? 10 summation process in a step SI, the input image signals 

R, G and B are converted into a brightness Y being a 

^l component of image brightness and color difference 

03 signals Cr and Cb being components of hue (Bl in Fig. 

B 3). A conversion expression thereof is as follows. 

m 15 Y = 0.299 X R + 0.587 x G + 0.114 x B 

Hi 

01 Cr = R - Y 

Cb = B - Y 

Next, as to the signal Y corresponding to the 
brightness among the converted signals Y, Cr and Cb, a 

20 brightness value (value of signal Y) for each pixel in 
the image data is investigated, and a histogram of 
brightness (frequency distribution) is created by 
summing the frequency of pixel having the corresponded 
brightness for each brightness value represented by 

25 values of 0 to 255. 

In this histogram, e.g., when the image data 
indicates an entirely light image, distribution is 
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biased to the high-brightness side as shown in Fig^ 5. 
On the other hand, when the image data indicates an 
entirely dark image, distribution is biased to the low- 
brightness side as shown in Fig. 6. 
5 It should be noted that since creation of the 

histogram of brightness is performed for the purpose of 
investigating the frequency distribution of the 
brightness in an entire image, the summation of 
frequency is not always performed to all pixels. For 
10 example, for image data of 1600 x 1200 pixels, the 

summation may be performed for the pixels thinned out 
Ul fifteen pixels by fifteen pixels in the lateral 

03 direction and eleven pixels by eleven pixels in the 

s longitudinal direction or may be performed by using an 

Lb 

nj 15 average value calculated from each of these pixels and 

n \ 

respectively corresponded surrounding pixels. 
%l (Gradation Curve Judgement) 

In a step S2, a gradation curve judgement process 
is performed on the basis of the histogram as above 
20 obtained. That is, it is judged that what kind of a 
gradation curve, which is a correction curve 
corresponding to the gamma value in a brightness 
correction, is to be defined. In the gradation curve 
judgement process according to the present embodiment, 
25 image brightness to be processed by two parameters 

described later, that is, a highlight point and a gamma 
parameter (the number of pixels in low-brightness area) 
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is to be judged, and the gamma value, that is, the 
gradation curve corresponding to the gamma value is 
defined on the basis of the judged result. 

Fig. 7 is a flow chart showing the gamma judgement 
5 process in detail, and the gamma judgement process in 

the present embodiment will be explained with reference 
to this flow chart. 
(Highlight Point Judgement) 

In a highlight point judgement process of a step 
10 S21, a highlight point in an image to be processed is 
calculated on the basis of the histogram (step S211). 

In the present embodiment, the frequency of each 
brightness value is accumulated successively sliding 
from the highest brightness value (brightness value 
15 255) within a brightness range to the low-brightness 
pi side in the histogram of the brightness signal Y. As 

to the obtained cumulative frequency, e.g., the 
brightness value coincided with 1.0% of the number of 
all the pixels of the image data to be processed or the 
20 brightness value initially exceeding 1.0% of the number 
of all the pixels is obtained, and the point of this 
value is assumed to be a highlight point (hereinafter 
called "HLP"). 

Next, the magnitude of the HLP obtained in this 
25 way and the brightness value are compared each other 

using a previously determined threshold Th. When HLP > 
Th, it is judged that the image is a light image, and 
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when HLP < Th, it; is Judged that the image is a dark 
image (step S212). That is, according to this process, 
two kinds of images are discriminated in their 
lightness and darkness. As the threshold Th to be used 
in the present embodiment, a comparatively high- 
brightness value such as a value 220 or the like is 
used- 

For example, in a histogram of a comparatively 
light image shown in Fig. 5, the HLP exceeds the 



10 threshold Th (HLP > Th). Accordingly, it is judged 
N that the image is light. In this case, since the 

yi distribution of the histogram is overall biased to the 

QJ high-brightness side as above, the HLP is positioned on 

g the high-brightness side as a result. 

15 On the other hand, in a histogram of a 

comparatively dark image shown in Fig. 6, the HLP is 
*2f equal to or less than the threshold Th (HLP < Th). 

Accordingly, it is judged that the image is dark. In 
this case, since the brightness distribution is overall 
20 biased to the low-brightness side and the HLP is 

positioned on the low-brightness side, the judgement is 
obtained. 

As above, the highlight point is obtained on the 
basis of the histogram of the image to be processed. 
25 Based on this method, by entirely judging the light and 
darkness of the image, the extent of correction, that 
is, the gamma value can be varied associated with the 
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dis-tribution in a low-brightness area of the image to 
be processed according to the discriminated light and 
darkness, as described later in Fig. 8. For example, 
when it is judged that the image is dark, probability 
5 of correcting the image by the small gamma value 

(increase density, to be darker) can be decreased as 
compared with a case that it is judged that the image 
is light even in the distribution of the same low- 
brightness area (ratio of the low-brightness area). 
10 Accordingly, an entirely dark image, that is, an image 
having a little distribution in the low-brightness area 
4i can be printed with an entirely low density and so- 

03 called crush (or break) in a high density part in a 

n print image can be prevented- On the contrary, when it 

|1J 15 is judged that the image is light, the probability of 

fjj 

Ol correcting the image by the small gamma value (increase 

pi density, to be darker) can be increased. Accordingly, 

it becomes possible to compensate a comparatively low 
density output characteristic primarily held by a 
20 printing device such as a printer or the like. 

It should be noted that a calculation of the HLP 
is not always required by the abovementioned method but 
may be applicable to properly use a conventional known 
system. 

25 In case of performing the automatic gradation 

correction process of the present embodiment, by using 
another image correction process, e.g., combining with 
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the above color fog correct:ion, a contrast: correction 
and a saturation correction, the HLP previously used in 
this image process can also be used. Furthermore, 
lightness (darkness) of an image can be discriminated 
using a shadow point similarly used in the above color 
fog correction or the like. According to this fact, it 
is apparent from the following explanation that the 
following process can be performed. 

(Judgement of the Number of Pixels (Judgement of Gamma 
Parameter) in Low-Brightness Area (Shadow Area)) 

Next, in a step S22, a judgement of low-brightness 
area distribution is similarly performed using the 
histogram obtained in the step SI for the images 
roughly classified into two categories of the light 
image and the dark image by the highlight point 
judgement . 

In the judgement process of the number of pixels 
in the low-brightness area, initially, an S^^^ being a 
ratio of the cumulative frequency in a predetermined 
low-brightness area to the number of all the pixels of 
an image to be processed is obtained in a step S221. 
Correction degree, that is, a suitable gamma value is 
calculated by detailedly obtaining the low-brightness 
area distribution, and an entire increase of the 
density can be realized without generating the crush 
particularly in the low-density area in the print 
image . 



First, as a preprocess, a cumula-tive frequency S 
in the low-brightness area is calculated. The 
cumulative frequency S in the low-brightness area is 
obtained as the cumulative frequency accumulated up to 
a predetermined brightness value sliding from the 
lowest brightness value (brightness value 0) to the 
high-brightness side within a brightness range, in the 
histogram. In the present embodiment, a cumulative 
frequency accumulated up to a brightness value 
(brightness value 64) being a quarter of the maximum 
brightness value (brightness value 255) is obtained as 
the cumulative frequency S in the low-brightness area. 

Next, the ratio S^^^ being a ratio of the obtained 
cumulative frequency S in the low-brightness area to 
the number of all the pixels is calculated. 

That is, the ratio S^^w is expressed as follows. 

Slow = (cumulative frequency S in the low- 
brightness area)/ (the number of all the pixels) (%) 

In case of performing the histogram summation, if 
a thinned-out histogram is created by thinning out the 
pixels, a denominator in the above definite expression 
of the ratio S^^w the number of pixels to be 
performed histogram creation - 

Next, in a step S222, a judgement of the gamma 
value (gamma parameter) is performed using the above- 
obtained ratio Si^j„. 

More particularly, this judgement is the process 
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of determining a range con-taining -the ratio S^^^ in a 
table shown in Fig. 8, That is, the range of the ratio 
SiQ„ is varied according to the light and darkness of 
the image corresponding to the HLP judgement. As to 
5 the image Judged to be a light image, the ratio S^^^ is 
classified into three kinds of ranges of the ratio S^^^ 
= 0 to 30, the ratio S^^^ = 31 to 60 and the ratio S^^^ 
exceeding 61. On the other hand, as to the image 
judged to be a dark image in the HLP judgement, the 
10 ratio S^^^ is classified into three kinds of ranges of 
the ratio S^^^ = 0 to 15, the ratio S^^^ = 16 to 30 and 
U1 the ratio S^^^^ exceeding 31. 

m For example, in case of the comparatively light 

Lib 

g image shown in Fig. 5, the ratio of the area indicated 

f|l 15 by oblique lines to the number of all the pixels is to 

n ^ 

gS be S^o^. In this example, the ratio S^^w reaches 10%. 

5f Therefore, the image is judged to be the light image by 

the HLP judgement and it is Judged that the ratio S^^^ 
is in the range 0 to 30, On the other hand, in case of 
20 the comparatively dark image shown in Fig. 6, a ratio 

of the area of the ratio S^^^ indicated by oblique lines 
to the number of all the pixels reaches 40%. 
Therefore, the image is judged to be the dark image by 
the HLP judgement and it is judged that the ratio S^^^ 
25 is in a range exceeding 31. 

Here, in case of using a method of judging the 
distribution of the low-brightness part only using the 
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shadow point (e.g», brightness value being a value of 
coinciding with 1.0% for the number of all the pixels 
or initially exceeding 1.0% in case of accumulating 
each frequency successively sliding from the minimum 
brightness value to the high-brightness side in the 
histogram) without using the ratio of the above 
cumulative frequency, a judgement of image brightness 
wherein an actual distribution state of the low- 
brightness area is not properly reflected is to be 
performed. For example, in case of an image having a 
little frequency distribution of the low-brightness 
area because of actually existing a peak of the 
frequency distribution on near the shadow point, even 
if the shadow point itself is indicating a 
comparatively high-brightness value, an erroneous 
judgement that the image is comparatively light is 
given and a small gamma value (brightness correction of 
increasing density) is selected. As a result, a dark 
part occupying a comparatively large part on the image 
is sometimes crushed - 

For this problem, by obtaining the cumulative 
frequency in the low-brightness area and using the 
ratio Sj^o„ of the cumulative frequency to the number of 
all the pixels as the abovementioned embodiment, it 
becomes possible to perform a judgement of the light 
and darkness of an image on which more actual low- 
brightness distribution is reflected. Accordingly, a 
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suitable gradation correction can be performed for the 
above comparatively dark image. 

In the present embodiment, as to the range of the 
ratio Sio„, although the range of the brightness values 
0 to 60 is uniformly divided, if more detailed 
information of the low-brightness area is to be 
obtained, the low-brightness area may be divided into 
some parts and the situation division may be performed 
to each of the divided parts. Also, the ratio S^^^ may 
be weighted twice in the range of the brightness values 
0 to 30 and once in the range of the brightness values 
31 to 60, and then weighted values may be added, 
(Determination of Correction Gamma Value) 

According to the above judgement process of the 
number of pixels in the low-brightness area, the image 
to be processed is classified into six kinds of images, 
that is, three kinds of light images and three kinds of 
dark images as shown in Fig. 8 by determining the range 
including the ratio S^^^ in the low-brightness area. 
The, in a next step S23, the gamma value is determined 
using the table shown in Fig. 8. 

As apparent from a gradation curve (correction 
table) shown in Fig. 9, the gamma value 0.8, 1,0 or 1.2 
is set. As described above, the gamma value represents 
the degree of correcting an image to more light image 
(lower density in the print image) and does not 
represent a correction ratio for each input brightness 
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value. The correction ratio for each the input value 
is represented by the curve indicating each table 
content shown in Fig . 9 . 

The determination of the gamma value regarding the 
5 image classified into the six kinds of images is 

performed using the table shown in Fig. 8 as follows. 
For example, in a case where the image is judged to be 
the light image by the HLP judgement, the gamma value 
is set as Y = 0-8 when the ratio S^^w = O to 30, y = 1.0 
10 (i.e., not corrected) when the ratio S^^ow = 31 to 60, 
and Y = 1-2 when the ratio Si-.^ exceeds 61, More 

i ;*= 

H,l particularly, correction look-up tables (LUT) 

'f^ corresponding to each of the gamma values are prepared 

f as described later. 

hah 

nj 15 In case of the comparatively light image shown in 

01 Fig. 5, since the HLP is larger than the threshold Th 

£3 and the ratio S^^^ is equal to 10%, the image is judged 

to be the light image using the table content shown in 
Fig. 8 and the gamma value is set as 0.8. According to 
20 the gamma value determination, a correction of also 
reducing brightness (increase printing density) of a 
comparatively high-brightness area is performed and the 
print image becomes to have entirely optimum density. 
Also, since the ratio of the ratio S^^^ in the pixels of 
25 the low-brightness area is in a low level, crushed 
parts in an image can be resulted in a few parts. 

On the other hand, in case of the comparatively 



- 24 - 



dark image shown in Fig. 6, since the HLP is less -than 
the threshold Th and the ratio S^^^ is equal to 40%, the 
gamma value is set as 1.2 using the table content shown 
in Fig. 8. According to the gamma value determination, 
an entire of the image to be printed becomes light. 
Especially, the low-brightness area occupies 40% of the 
image becomes light, thereby obtaining a print image 
having an excellent density balance. 

In the above description, although the judgement 
of image brightness is performed by the case division 
of two stages in the HLP judgement (521), more detailed 
judgement may be performed by dividing the case into 
three stages of a light image, an intermediate 
brightness image and a dark image or into more than 
three stages in order to obtain more suitable gamma 
value. In this case, in the judgement of the number of 
pixels in the low-brightness area (S22), in case of the 
intermediate brightness image, in addition to the 
threshold for the ratio S^^^ indicated in Fig. 8, e.g., 
the gamma value may be set as y = 0.8 when the ratio 
Slow = 0 to 20, Y = 1-0 when the ratio S^^^ = 21 to 40 and 
Y = 1.2 when the ratio S^^w exceeds 41 . 

(Gradation Maintenance Judgement in Low-Brightness Area 
( Shadow Area ) ) 

Next, in a step S24 of Fig. 7, the gradation 
maintenance judgement in the low-brightness area is 
performed. In case of performing the correction based 



- 25 - 



on the gamma value determined as above, it: is judged 
whether there is the high-density part crushed by what 
extent of density on the print image obtained by the 
above correction. Then, in accordance with the judged 
result, it is judged whether or not the gradation in 
the high-density area is to be maintained, when the 
density of the print image is increased by performing 
the gamma correction process. 

First, frequency up to a predetermined point 
(brightness value X) is accumulated sliding from the 
lowest brightness value ( brightness value 0 ) to the 
high-brightness side in a brightness range in the 
histogram obtained as above. For example, this value X 
can be set as a point (brightness value 32) being 1/8 
times of the maximum brightness value (brightness value 
255). The brightness range up to this value X is such 
a range, in which the gradation curve can be corrected 
in a gradation curve determination process described 
later. In other words, this range is a range capable 
of obtaining an image entirely having an excellent 
gradation of preventing the color crush while 
maintaining the gradation in the high-density part on 
the print image by adjusting the gradation in this 
range. This range can be obtained experientially or 
experimentally. 

The cumulative frequency obtained up to the value 
X in this way is assumed to be an S ' - Next, the 
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percentage of the cumulative frequency S ' to the number 
of all the pixels is calculated • A ratio of the 
cumulative frequency to the number of all the pixels in 
the low-brightness area is assumed to be an S;^^^' . In 
5 this case, it is expressed as follows. 

^low' = (cumulative frequency S' in the low- 
brightness area )/( the number of all the pixels) (%). 

For example, in case of the image indicated by the 
histogram shown in Fig. 5, an area indicated by dark 
^% 10 oblique lines is an area having a ratio represented by 

j« the ratio S^^^' , and this ratio reaches 5%. As in this 

-J example, when the ratio S^^^* is small, even if a 

correction of increasing the density of the print image 
is performed by setting the gradation curve of the 

: : 
™ zz 

nj 15 small gamma value, it is apparent from Fig. 5 that an 

01 area of color crushed is minimized. On the other hand, 

p in the example shown in Fig. 6, the ratio S^^^' reaches 

20%. In this example, the ratio S^^^' is a 
comparatively large value. In this case, when the 
20 gradation curve of the small gamma value is set, color 
from the intermediate-brightness area to the high- 
brightness area becomes clear. However, the high- 
density area of the print image obtained by correcting 
the low-brightness area occupying 20% of this area is 
25 darkly crushed. 

(Determination of Correction Gradation Curve) 

On the basis of the ratio S^^w* obtained by the 
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gradation maintenance judgement process in the low- 
brightness area performed in the step S24 described 
above, a correction gradation curve determination 
process is performed in a step S25. That is, in this 
process, attention is payed on the ratio S^^^^', and the 
gradation curve capable of increasing the density of 
the image is set without generating the crush in the 
high-density area in the print image depended on a 
result obtained by correcting the low-brightness area. 
More particularly, for each gamma value obtained by the 
above determination process of the correction gamma 
value (S23), a range and inclination of a linear graph 
for maintaining gradation in the low-brightness area on 
the gradation curve are defined on the basis of the 
ratio S, ' . 

In Fig. 10, for example, with respect to an image 
to be processed, if it is assumed that the gamma value 
is defined as y = 0.8 in the above determination 
process of the correction gamma value ( S23 ) , then the 
ratio Si^^' is defined as the ratio S^^^' = 0 to 5 in the 
above gradation maintenance judgement process in the 
low-brightness area (S24), since it is judged that the 
ratio of an area to be darkly crushed is in a low level 
even if the density of an entire print image is to be 
increased, the gradation curve, which is represented by 
the above expression simply using the obtained gamma 
value as it is, is to be adopted. On the other hand. 
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when the gamma value is 0.8 and the ratio S^^^' exceeds 
6%, if the density of an entire print image is to be 
increased, it is judged that the ratio of an area of 
the high-density part to be darkly crushed is in a high 
level, and gradation of pixels corresponding to the 
brightness value from O to X is maintained (i.e., 
correction is not performed by assuming that the gamma 
value is equal to one). In the range corresponding to 
the brightness value from (X + 1) to the maximum 
brightness value (brightness value 255), the correction 
based on the gradation curve ( curve represented by an 
expression of the ratio Si^^' = 20 in Fig. 9) 
represented by the same expression as that of the above 
expression is performed. More particularly, in an 
example shown in Fig. 10, the following expressions are 
given. 

Y' = Y within a range 0 < Y < 30, and 
Y' = 224 X {[(Y-31)/224]^} + 31 within a range 31 
< Y < 255. 

The above explanation relates to a case that the 
gamma value is equal to 0,8. However, the threshold 
used in discriminating if the gradation curve is 
changed or not changed according to the above ratio 
Slow' (^s above example, when the gamma value is equal 
to 0.8, the ratio S^^^' becomes 6) can be varied every 
the gamma value. However, when the gamma value exceeds 
1.0, since the correction does not become a correction 
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of increasing the density of the print image, the 
gradation curve is not changed in the present 
embodiment - 

It should be noted that the brightness value X is 
fixed as a constant value regardless of an image to be 
processed in the present embodiment, but the brightness 
value X may be varied depending on the histogram. In 
an example shown in F±g. 9, it is assumed that the 
correction is not performed (gamma value = 1) in the 
range of the brightness value is 0 to X. However, in a 
case where the ratio S^^^ is assumed to be 6% to 19%, 
the gradation in an area of exceeding the brightness 
value X may be extended by slightly erasing the 
gradation in the low-brightness area, e,g., inclining a 
linear inclination obtained from the gradation curve 
drawn between the brightness value 0 and the brightness 
value X to an inclination of 1/2. 

In the above example, as shown in Fig. 10, a 
straight line in the low-brightness area is simply 
linked with gamma curves in the intermediate brightness 
area and the high-brightness area. However, it is 
needless to say that more sequential representation of 
the gradation can be realized by smoothly linking the 
straight line with the curves. 
( LUT Creation ) 

When the above gradation curve judgement process 
(step S2 in Fig. 4) ended, the LUT is created in a step 
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S3 shown in Fig. 4. That is, the look-up table (LUT) 
used in correcting brightness is created on the basis 
of the gradation curve indicated by the gamma value 
obtained in the gradation curve judgement process. 

The LUT in the present embodiment performs a 
correction, wherein a value obtained by multiplying the 
maximum brightness value by a value calculated from a 
method of exponentially multiplying a ratio of each 
input brightness signal for the maximum brightness 
value by a reciprocal number of the gamma value 
obtained as above mention is treated as an output 
brightness signal. All the brightness values obtained 
in correcting relation using the above gamma value are 
written in the LUT corresponding to all the values 
(brightness value 0 to 255) within a range of 
brightness . 

That is, when an input brightness signal is 
assumed to be Y and an output brightness signal is 
assumed to be Y', the conversion expressed by an 
expression YV= 255 x [(Y/255)^/^] is performed, and an 
LUT L[Y] is dynamically created. That is, the LUT L[Y] 
is created every process of the image to be processed. 
By dynamically creating the correction table, it is 
possible to reduce the necessary memory size. 

It is needless to say that the above LUT may be 
statically provided on a memory beforehand for each 
gamma value, instead of the dynamic creation. 



( Correction ) 

Next, in a step S4 of Fig. 4, the brightness 
signal Y is corrected. That is, the brightness value Y 
of the input image is converted by the. created LUT L[Y] 
into Y' L[Y], and the correction is performed (the 
process of a block B2 (gamma conversion unit) shown in 
Fig. 3). 

Further, the brightness signal Y' of which 
brightness was corrected and color difference signals 
Cr and Cb are replaced to the signals R, G and B (the 
process of a block B3 shown in Fig. 3), then signals 
R ' , G ' and B * are created . 

It should be noted that the correction of the 
brightness signal Y is explained in the present 
embodiment, however, the similar correction may be 
directly performed to each of the signals R, G and B. 
In this case, the above LUT is used, and in this LUT, 
the correction can be performed by using the signals R, 
G and B instead of the signal Y and the signals R', G' 
and B * instead of the signal Y ' . 

Since the correction to be performed to the 
signals R, G and B does not require RGB-YCrBr 
conversion, it is possible to increase process speed. 
[Second Embodiment] 

The present embodiment relates to another example 
of the HLP judgement concerning a so-called backlight 
image. Since the printing system in the present 
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embodiment is the same as that in the abovementioned 
first embodiment, the explanation thereof will be 
omitted- The different point is only the following 
process . 

(Process for Backlight Image) 

In taken images such as a digital photograph and 
the like, there is the backlight image of which 
background area is light and subject area is dark. 
Fig. 10 shows a typical histogram of the backlight 
image - 

As shown in Fig. 10, a great peak appears in the 
high-brightness area of the histogram in correspondence 
with the light background. Due to this peak in the 
high-brightness area, HLP > Th is given in the image 
lightness judgement based on the HLP explained in the 
abovementioned first embodiment. Thus, even if the 
subject itself is dark, there is some fear that the 
entire image is erroneously judged to be a light image. 

Thus, in the present embodiment, before the HLP 
judgement is performed, the process to previously cut 
an unnatural peak appeared in the high-brightness area 
is performed. 

For example, in the histogram of Fig. 10 
representing the backlight image, the unnatural peak in 
the high-brightness area represents the backlight on 
the background. Thus, by performing the process to 
previously cut this unnatural peak, it is possible to 
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perform gamma judgement: which values -the subject 
withoui: being influenced by the high-brightness 
background area. Fig. 11 shows a histogram which is 
obtained by cutting the unnatural peak corresponding to 
the background area in the histogram of the backlight 
image of Fig. 10. 

The cutting of the peak of the background area is 
performed as follows. 

First, it is assumed that the peak exists over the 
five-pixel width (the brightness values 240 to 244) in 
the vicinity of the brightness value 240. In this 
situation, in the high-brightness area (e.g., the 
brightness values 230 to 255), to smooth the frequency 
of the peak according to the average value of the 
frequency of the brightness in the high-brightness area 
on the periphery of the range where the peak exists, 
several pixel values in the peak are extracted in the 
highest- frequency order. The number of pixel values to 
be extracted should have, even if the lowest, five or 
more being the number of pixels in the peak so as to 
cut the peak area entirely. Here, it is assumed that 
seven pixel values are extracted. Next, the average 
value of the frequency is obtained by the remaining 
brightness values (26 - 7 = 19), and the frequency of 
each of the five brightness values of the peak area 
extracted previously is replaced with the average 
value, whereby the peak is smoothed by the average 
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value. 

As described above, the peak of the high- 
brightness area existing in the background image can be 
cut and averaged, whereby the brightness of the HLP can 
be decreased below the threshold Th. Namely, this 
image can be judged to be the original dark image. As 
a result, although the set gamma value is 0.8 in the 
histogram before the peak correction shown in Fig. 10, 
the gamma value can be set to be 1.0 by decreasing the 
highlight point in correspondence with the true image 
as shown in Fig. 11, whereby the unnecessary correction 
can be omitted. 
[Third Embodiment] 

Generally, it is known that an output image 
becomes fine by appropriately increasing its density 
and thus the excellent and satisfactory image can be 
obtained. However, if the density of the output image 
is increased uniformly, in an image containing a lot of 
dark parts, gradation in such the dark part is crushed 
or failed, whereby image quality is rather decreased 
occasionally. 

On the other hand, in a photograph taken nighttime 
or indoors dark, the entire image thereof is dark due 
to under exposure or the like, whereby the color in the 
image might be too different from the true color. In 
this case, by decreasing the density of the output 
image, it is possible to lighten the dark image overall 
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and thus finish it up in the detail obviously. 

Further, a dynamic range of brightness of an image 
might narrow very much due to accuracy of a CCD of a 
digital camera or a photographing condition. In such a 
5 case, by expanding the gradation of the image, it is 
possible to convert the obtained image into an image 
which is contrastedly and sightly. 

The present embodiment aims to increase the 
quality of the output image by appropriately setting a 
^ 10 correction condition according to the characteristic of 

the image . 

Hereinafter, like the first embodiment, automatic 
gradation correction of the present embodiment which is 
performed as the image correction process of Fig, 2 
15 will be explained. 

In the automatic gradation correction of the 
present embodiment, lightness of the image to be 
printed is judged by using a histogram in which 
frequency of brightness values in the image data are 
20 summed, and an appropriate correction gradation curve 
is determined based on the judged result. In the 
automatic gradation correction of the present 
embodiment, an image with few high density parts, i.e., 
shadow parts, is corrected by using the gamma curve 
25 (©•g-/ the gamma curve of convex below shown in Fig. 

18), and the density of the entire image is increased 
to bring it overall close to the density of the silver 
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bromide photograph output: by a device capable of 
performing high-density output. On the other hand, an 
image which is overall dark because there is a lot of 
shadow parts is corrected by using the gamma curve 
(e.g., the gamma curve of convex above shown in Fig. 
18) to lighten the image, whereby the balance of the 
entire image can be improved. Further, an image with 
narrow width of histogram is corrected by using the 
gamma curve (e.g., the S curve shown in Fig. 11) for 
expanding its dynamic range, whereby an image which is 
contrastedly and sightly can be obtained. 

Hereinafter, the automatic gradation correction in 
the present embodiment will be explained according to 
the process procedure shown in Fig, 4, 
( Histogram Summation ) 

In the histogram summation process in the step SI, 
input image signals R, G and B are first converted into 
a brightness signal Y representing a lightness 
component of the image and color difference signals Cr 
and Cb representing tint components of the image ( the 
block Bl of Fig. 3). Expressions of such the 
conversion are as follows - 

Y = 0.299 X R + 0.587 x G + 0.114 x B 

Cr = R - Y 

Cb = B - Y 

Next, in the converted signals Y, Cr and Cb, the 
brightness value (the value of the signal Y) of each 
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pixel in the image data is checked for the signal Y 
corresponding to the brightness, the frequency of the 
pixels having such the brightness value are summed for 
each of the brightness values represented 0 to 255, and 
5 the histogram (frequency distribution) of the 
brightness is created. 

In the histogram thus created, for example, when 
the image data represents a light image overall, the 
distribution is biased to the high brightness side as 
10 shown in Fig. 13, on the other hand, when the image 
"^'4 data represents a dark image overall, the distribution 

yi is biased to the low brightness side as shown in Fig. 

m 15. 

J- Since the above creation of the brightness 

1=1 1 15 histogram aims to check the frequency distribution of 

Lj; the brightness in the entire image, the frequency need 

not necessarily be calculated for all the pixels. For 
example, for the image data of 1600 (pixels) x 1200 
(pixels), the summation may be performed only to the 
20 pixels obtained by thinning out 15 pixels laterally and 
11 pixels longitudinally, or the summation may be 
performed by using average values of the thinned-out 
pixels and their peripheral pixels. 
( Gradation Curve Judgement ) 
25 In the step S2, a correction condition setting 

process (a gradation curve judgement process) is 
performed based on the obtained histogram. Namely, a 
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gradation curve is selected from among plural gradation 
curves prepared beforehand for brightness correction, 
on the basis of the image analysis result. 

In the gradation curve judgement of the present 
embodiment, lightness of the image is Judged based on 
three parameters (a highlight point, a shadow point, 
and the number of pixels of one brightness area), and 
the gradation curve is selected based on the judged 
lightness . 

Fig. 16 is a flow chart showing the detail of the 
gradation curve judgement process, and the gradation 
curve judgement process in the present embodiment will 
be explained with reference to this flow chart. 
(Highlight Point Judgement) 

In the highlight point judgement process in a step 
S31, a highlight point in the image being the process 
object is calculated from the above histogram. 

In the present embodiment, from the maximum 
brightness value (the brightness value 255) within the 
brightness range in the histogram of the brightness 
signal Y, the frequency of the respective brightness 
values are accumulated toward the low brightness in due 
order. Then, the brightness value in which the 
obtained cumulative frequency is consistent with 1.0% 
of all the pixels in the image data being the process 
object or first exceed 1.0% of all the pixels is 
obtained, and this value is set to be a highlight point 
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(hereinafter called "HLP"). 

Next, the HLP is compared with plural 
predetermined thresholds Th_Hl, Th_H2, ... ( Th_Hl < 
Th_H2 < ♦ . . ) to analyze the distribution in the high- 
brightness area of the histogram. 

For example, in the present embodiment, a case as 
shown in Fig. 17 where two thresholds to which values 
200 and 230 are set from below in due order will be 
explained. 

When HLP < Th_Hl, the image is judged to be an 
image of which high-brightness area is small and which 
is thus dark. When Th_Hl < HLP < Th_H2, the image is 
judged to be an image which contains the distribution 
of the high-brightness area but is dark overall. When 
Th_H2 < HLP, the image is judged to be an image which 
contains a lot of distribution of the high-brightness 
area and is thus light overall. 

For example, in a histogram of a comparatively 
light image shown in Fig. 13, the HLP exceeds the 
threshold Th_H2 (HLP > Th_H2 ) , whereby the image is 
judged to be the image which contains a lot of 
distribution in the high-brightness area. In this 
case, since the distribution of the histogram is 
overall biased to the high-brightness side, the HLP is 
positioned on the high-brightness side as a result. 
The image of such the distribution is generally a light 
image. 
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In a histogram shown in Fig, 14, -the HLP is lower 
than the threshold Th_H2 and higher than the threshold 
Th_Hl (Th_Hl < HLP < Th_H2 ) , whereby the image can be 
considered to the image which contains the distribution 
of the high-brightness area to some extent but is not 
light. In the histogram of Fig. 6, since the 
brightness roughly shows intermediate distribution and 
is positioned comparatively on the low-brightness side, 
such the judgement as above is possible. 

In a histogram shown in Fig. 15, the HLP is lower 
than the threshold Th_Hl, whereby the image can be 
considered to the image which does not contain the 
distribution of the high-brightness area. In this 
case, it can be understood that the histogram is biased 
to the low-brightness side and thus the image is dark 
overall. The HLP low represents that, i.e., the 
gradation level is narrow. Thus, for such the image, 
it is necessary to lighten the image by gamma 
correction or by expanding the brightness value to the 
high-brightness side . 

It should be noted that the calculation of the HLP 
need not necessarily depend on the above method, and 
may properly depend on the conventional method. 

Further, it should be noted that, when the 
automatic gradation correction process in the present 
embodiment is combined with other image correction 
process such as the above color fog correction, the 
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contrast correction or the saturation correction, the 
HLP previously used in the above image process can be 
used. In this case, instead of the HLP, lightness 
(darkness) of the image can be judged by using a shadow 
point similarly used in the above color fog correction 
or the like, and the following process possible based 
on this will be clear from the following explanations. 
(Balance Judgement of Histogram) 

In a step S32, the balance of the histogram is 
judged by using the histogram obtained in the step SI 
of Fig. 4, 

In a balance judgement process of the histogram, 
an S^Q^ being a ratio of the cumulative frequency in a 
predetermined area to the number of all the pixels of 
an image to be processed is obtained in the step S32. 
Namely, the ratio of the number of the cumulative 
pixels of the brightness values 0 to 128 (half of the 
histogram) to the number of all the pixels is obtained 
for the image of, e.g., 256 gradations, and the entire 
balance of the histogram of this image is analyzed. 

First, a cumulative frequency S in one-brightness 
area (0 to 128) is calculated. This cumulative 
frequency S is obtained as the cumulative frequency 
accumulated up to a predetermined brightness value 
sliding from the lowest brightness value (brightness 
value 0) to the high-brightness side within a 
brightness range of the histogram. In the present 
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embodiment, although the cumulative frequency up to the 
brightness value (brightness value 128) being the half 
of the maximum brightness value (brightness value 255) 
is obtained as the cumulative frequency S in the low- 
brightness area, of course other value may be used. 

Next, the ratio S^^^ being a ratio of the obtained 
cumulative frequency S to the number of all the pixels 
is calculated by using the following expression. 

Slow = (cumulative frequency S in one-brightness 
area )/( the number of all the pixels) (%) 

In the above histogram summation, when the pixels 
are thinned out to create the thinned-out histogram, 
the denominator of the expression of the ratio S^^ow 
to the number of pixels to which the histogram is 
created. 

Next, the threshold is again judged by using the 
ratio S^Q^ obtained as above. The purpose of this is to 
check the overall brightness balance of the image by 
calculating the ratio which occupies the whole in the 
lower half of the histogram. In the above highlight 
point judgement, the image is classified into plural 
kinds in accordance with the distribution state of the 
high-brightness area of the histogram, and as shown in 
Fig. 17 the threshold corresponding to each case is 
provided to judge the degree of the balance of the 
histogram. 

For example, in case of the comparatively light 
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image shown in Fig. 13, the ratio of the area indicated 
by oblique lines to the number of all the pixels is to 
^® ^low this example, since the ratio S^^^ reaches 

20%, the image is judged to be the light image by the 
HLP judgement and it is judged that the ratio Sjlo„ is in 
the range 16 to 50 . 

On the other hand, in case of the comparatively 
dark image shown in Fig, 15, since the ratio S^^^ 
indicated by oblique lines to the number of all the 
pixels reaches 60%, the image is judged to be the dark 
image by the HLP judgement and it is judged that the 
ratio SiQ„ is in a range 50 to 80. 

In the method of judging the balance of the 
histogram by using only the intermediate value or the 
average value of the histogram without using the ratio 
of the cumulative frequency in one-brightness area, the 
lightness of the image on which the actual distribution 
of the histogram is not appropriately reflected is 
judged. For example, there is an image that the 
intermediate value or the average value indicates a 
comparatively high-brightness value, but the peak of 
the frequency distribution actually exists in the 
brightness value around the intermediate value or the 
average value, and the frequency distribution in the 
low-brightness area is a little. There is a case where 
such the image is erroneously judged to be the light 
image, the brightness correction to increase the 
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density is thus selected, and the dark part which 
occupies a comparatively large part in the image part 
crushes as a result. 

On the other hand, in the present embodiment, the 
5 cumulative frequency in the area of the brightness 

values 0 to 128 being the lower half of the histogram 
is obtained, and the ratio Si^,„ of the cumulative 
frequency to the number of all the pixels is used, 
whereby the lightness of the image on which the actual 
10 distribution of the histogram is well reflected can be 
'"'■^ judged, and appropriate gradation correction is 

U1 possible even to such the dark image as above - 

□3 In the present embodiment, as to the range of the 

3 ratio S^Q^, although the range of the brightness values 

nj 15 0 to 128 is uniformly divided, if more detailed 

i4S information of the low-brightness area is to be 

pf obtained, the low-brightness area may be divided into 

some parts and the situation division may be performed 
to each of the divided parts. Also, the ratio S^^^ may 
20 be weighted twice in the range of the brightness values 
0 to 64 and once in the range of the brightness values 
65 to 128 and then weighted values may be added. 
(Shadow Point Judgement) 

In a shadow point judgement process in a step S33, 
25 the shadow point in the image being the process object 
is first calculated from the above histogram. 

In the present embodiment, the frequency of each 
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brightness value is accumulat:ed successively sliding 
from -the lowest brightness value (brightness value 0) 
within a brightness range of the histogram to the high- 
brightness side. As to the obtained cumulative 
frequency, e,g., the brightness value coincided with 
1,0% of the number of all the pixels of the image data 
to be processed or the brightness value initially 
exceeding 1.0% of the number of all the pixels is 
obtained, and the point of this value is assumed to be 
a shadow point (hereinafter called "SDP"). 

Next, the SDP is compared with plural 
predetermined thresholds Th_Sl, Th_S2, ... (Th_Sl < 
Th_S2 < . . . ) to analyze the distribution in the low- 
brightness area of the histogram. 

Since the shadow point judgement in the present 
embodiment is performed after the highlight point 
judgement and the histogram balance judgement were 
performed, the threshold for the shadow point is 
different according to the results of the highlight 
point judgement and the histogram balance judgement as 
shown in Fig. 17. 

When SDP > Th_S2, the image is judged to be an 
image of which low-brightness area is small and which 
is thus light. When Th_Sl < SDP < Th_S2, the image is 
judged to be an image which contains the distribution 
of the low-brightness area but is light overall. When 
SDP < Th_Sl, the image is judged to be an image which 
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con-tains a lot: of distribution of the low-brightness 
area and is thus dark overall. 

For example, in the histogram of the comparatively 
light image shown in Fig. 13, the SDP exceeds the 
threshold Th_S2 (SDP > Th_S2 ) , whereby the image is 
judged to be the image which contains no distribution 
in the low-brightness area. In this case, since the 
distribution of the histogram is overall biased to the 
high-brightness side as described above, the SDP is 
positioned on the high-brightness side as a result. 
The SDP high represents that, i.e., the gradation level 
is narrow. Thus, for such the image, it is necessary 
to darken the image by the gamma correction or by 
expanding the brightness value to the low-brightness 
side. 

On the other hand, in the histogram of Fig. 14, 
the SDP is lower than the threshold Th_S2 and higher 
than the threshold Th_Sl (Th_Sl < SDP < Th_S2 ) , whereby, 
the image can be considered to the image which contains 
the distribution of the low-brightness area to some 
extent but is not dark. In this case, since the 
brightness roughly shows intermediate distribution and 
the SDP is positioned comparatively on the low- 
brightness side, such the Judgement as above is 
possible. 

In the histogram of Fig. 15, the SDP is lower than 
the threshold Th_Sl, whereby the image can be 
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considered to "the image which contains a lot of 
distribution of the low-brightness area. In this case, 
it can be understood that the histogram is biased to 
the low-brightness side and thus the image is dark 
5 overall, 

(Determination of Correction Gradation Curve) 

As shown in Fig. 17, the image to be processed is 
classified into plural kinds in accordance with the 
above three parameters, i.e., the detail of the 
10 distribution of the high-brightness area in the 
^ histogram (the highlight point), the ratio S;^^„ (the 

Ul balance degree of the histogram), and the detail of the 

03 distribution of the low-brightness area (the shadow 

|ssj= 

n point). Then, in a next step S34, the correction 

a\ 15 gradation curve is determined by using the correction 

)ii table shown in Fig. 17. 

In the present embodiment, as apparent from the 
correction table shown in Fig. 17, for example, if the 
highlight point is comparatively low, the gradation 
20 curve by which a process to cut the high-brightness 
area and expand the histogram to the high-brightness 
side is added is selected by judging overall the image 
kind according to the three paramters. Further, the 
gradation curve to perform gamma correction is selected 
25 to the image of which histogram balance is intended to 
be adjusted. If the balance degree (the ratio) S^^^ of 
the histogram is biased to the low-brightness area, the 
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gradation curve by which a process to lighten the image 
with gamma conversion or the like is selected. 
Further, if the shadow point is comparatively high, the 
gradation curve by which a process to cut the low- 
5 brightness area and expand the histogram to the low- 
brightness side is added is selected. In any case, the 
gradation curve concerning the plural classified images 
as above is determined by using the judgement table 
shown in Fig, 17. 

'=11 10 For example, in case of the image that the HLP is 

^ 245 (high), the ratio S^^^ is 20% and the SDP is 60 

Ul (comparatively high), the gradation curve by which the 

UJ low-brightness area (20 or less) is cut is selected- 

5 In case of the light image shown in Fig. 13, since 

S I 

nj 15 the HLP is larger than the threshold Th_H2, the ratio 

ffl S^o^ is 20% and the SDP is larger than the threshold 

'ft Th_S2, this image is judged to be the light image by 

using the table shown in Fig. 17, and the gamma value 
is set to be 1.1. Based on this set gamma value, the 
20 correction to darken the image up to the comparatively 
high-brightness area (i.e., increase a printing 
density) is performed, whereby the printed image of 
which density is optimum overall can be obtained. 
Further, since the ratio is small in the pixel of the 
25 low-brightness area, the part where the image crushes 
can be a little. 

Next, in case of the image that the histogram 




balance is intermediate as shown in Fig. 14, since the 
HLP is larger than the threshold Th_Hl and smaller than 
the threshold Th_H2, the ratio S^^^ is 40% and the SDP 
is larger than the threshold ThSl and smaller than the 
threshold Th_S2, the contrast of this image can be 
emphasized by selecting the S-shaped correction 
gradation curve by using the table shown in Fig. 17. 
Thus, there is modulation in the entire printed image, 
whereby the sightly image can be obtained. 

On the other hand, in case of the dark image shown 
in Fig. 15, since the HLP is smaller than the threshold 
Th_Hl, the ratio S^^^ is 60% and the SDP is smaller than 
the threshold Th_Sl, the straight line by which the 
value 200 or more is cut in the high-brightness area is 
selected by using the table shown in Fig. 17. Thus, 
the printed image is light overall, especially the 
histogram of the image is expanded to the high- 
brightness side, whereby the well -contrasted and 
density-balanced printed image can be obtained. 

In the above explanation, although the three-step 
lightness judgement for the high-brightness area of the 
image is performed in the highlight point judgement 
(S31), four-step or more lightness judgement to obtain 
the further optimum gradation curve may be performed 
for more detailed judgement. Further, even in the 
histogram balance judgement (S32) and the shadow point 
judgement (S33), the number of options may be increased 
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for more detailed judgement. 
(LUT Creation) 

When the above gradation curve judgement process 
(step S2 in Fig. 4) ended, the LUT is created in the 
step S3 shown in Fig. 4. That is, the look-up table 
(LUT) used in correcting brightness is created on the 
basis of the gradation curve obtained in the gradation 
curve judgement process. 

The LUT in the present embodiment stores the 
above-obtained gradation curve as an exponential 
function and a fifth-order function. Namely, the 
exponential function (Fig. 18) is used when only the 
gamma correction is simply performed, while a fifth- 
order curve (Fig. 19) is used when the correction is 
performed by using the straight line for cutting the 
high-brightness or low-brightness area and the 
complicated curve . 

That is, when an input brightness signal is 
assumed to be Y and an output brightness signal is 
assumed to be Y*, the conversion expressed by an 
expression Y' = 255 x [ ( Y/255 )^/'*^] is performed, and the 
gamma value is obtained from the judged result. 

On the other hand, in case of the fifth-order 
curve, the conversion expressed by an expression Y' = A 
+ BxY + CxY"2 + Dxya + ExY"^4 4^ Fxy^S is performed, and 
the coefficients A, B, C, D, E and F are given. Thus, 
the fifth-order curve completes and is dynamically 
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created. That: Is, this is created every process of the 
image to be processed. By dynamically creating the 
correction table, it is possible to reduce the 
necessary memory quantity. 

It is needless to say that the above LUT may be 
statically provided on a memory beforehand for each 
gradation curve, instead of the dynamic creation. 
(Correction) 

Next, in the step S4 shown in Fig. 4, the 
brightness signal Y is corrected. That is, the 
brightness value Y of the input image is converted by 
the created LUT L[Y] into Y* = L[Y], and the brightness 
correction is performed (the process of the block B2 in 
Fig. 3). 

Further, the brightness signal Y' of which 
brightness was corrected and color difference signals 
Cr and Cb of the input image are returned to the 
signals R, G and B (the process of the block B3 in Fig. 
3), then corrected image signals R', G' and B' are 
created. 

According to the present embodiment, in the 
histogram, it is possible to obtain the component value 
representing that the cumulative frequency from the 
maximum or minimum value of the range of the component 
value concerning the lightness of the image data 
represents a predetermined value, whereby entire 
lightness of the image can be known. Further, it is 
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possible "to obtain the ratio of the cumulative 
frequency from the maximum or minimum value up to the 
predetermined component value to the number of all the 
pixels of the histogram, whereby the distribution of 
the lightness of the image can be known. Further, it 
is possible to judge the distribution of the lightness 
based on the component value and the ratio and then 
determine the correction gradation curve based on the 
judged result, the correspondence between the 
distribution of the lightness and the correction 
gradation curve can be varied for each of entire 
lightness of the image . 

Namely, one optimum correction gradation curve for 
the image can be finally selected from among the plural 
correction gradation curves by using the three 
parameters, i.e., the highlight point, the balance 
degree of the histogram, and the shadow point. 

Thus, for example, in the overall dark image, the 
distribution representing the dark range can be 
deceased by the distribution of the lightness 
corresponding to the correction to further lighten 
(i.e., to decrease the density of the printed image), 
whereby the balance of the lightness in the printed 
image can be made more favorable. On the other hand, 
in the overall light image, the density of the printed 
image can be increased by more darkening, whereby the 
density output characteristic that a printing device 




can essentially achieve only compara-tively low density 
can be compensated, and high-density printing can be 
overall performed. Further, in an image with 
originally narrow dynamic range, it is possible to 
print a well-contrasted, density-balanced and sightly 
image . 

In the present embodiment, although the judgement 
is performed in the order indicated in Fig, 15, such 
the order may be changed. 

Further, the calculation of the HLP and the SDP is 
not limited to the above method, and a conventionally 
known method may be used appropriately. 

In any case, as described above, the highlight 
point is used to check the distribution in the high- 
brightness area, and the shadow point is used to check 
the distribution of the lightness in the low-brightness 
area. However, for example, if the detail of the 
distribution of the lightness in the high-brightness 
area can be known by using other parameter instead of 
the highlight point, such the parameter may be used. 
Namely, it is possible to obtain the ratio of the 
cumulative frequency from the maximum value of the 
histogram up to one brightness value (e.g., the 
brightness value 220) to the number of all the pixels, 
and perform the judgement of the distribution of the 
lightness in the high-brightness area from the obtained 
result. In this case, like the highlight point, plural 



-thresholds are provided for such the parameter, and the 
situation-division judgement is performed. Of course, 
even in the low-brightness area^, it is possible to 
obtain instead of the shadow point the ratio of the 
cumulative frequency from the minimum value of the 
histogram up to one brightness value (e.g., the 
brightness value 30) to the number of all the pixels, 
and perform the similar judgement. 

It should be noted that the correction of the 
brightness signal Y is explained in the present 
embodiment, however, the similar correction may be 
directly performed to each of the signals R, G and B. 
In this case, the above LUT is used, and in this LUT, 
the correction can be performed by using the signals R, 
G and B instead of the signal Y and the signals R', G' 
and B' instead of the signal Y* . Since the correction 
to be performed to the signals R, G and B does not 
require RGB-YCrBr conversion, it is possible to 
increase process speed. 
[Other Embodiments] 

As described above, the present invention may be 
applied to a system composed of plural devices (e.g., a 
host computer, an interface device, a reader, a 
printer, and the like), or to an apparatus consisting 
of one device (e.g., a copying machine, a fax machine, 
or the like). 

The present invention includes a case where the 
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program codes of software as shown in Figs. 4, 7 and 16 
for realizing the functions of the abovementioned 
embodiments to a computer provided in an apparatus or a 
system connected to various devices to operate these 
5 devices for realizing the functions of the 

abovementioned embodiments, and the computer (CPU or 
MPU) in the system or the apparatus operates the 
various devices according to the stored program. 

In this case, the program code itself of the 
M 10 software realizes the functions of the abovementioned 

"^-^ embodiments, whereby the program code itself and a 

4^ 

Ul means, e.g., a storage medium storing the program code, 

Co for supplying the program code to the computer 

H constitute the present invention. 

15 As the storage medium storing program code, e.g., 

a floppy disk, a hard disk, an optical disk, a 
magnetooptical disk, a CD-ROM, a magnetic tape, a 
nonvolatile memory card, a ROM, or the like may be 
used. 

20 It is needless to say that, when the functions of 

the abovementioned embodiments are realized not only in 
the case where the supplied program code is executed by 
the computer, but also in a case where this program 
code cooperates with an OS (operating system) running 
25 on the computer or other application software, such the 
program code is included in the embodiment of the 
present invention . 



Furtrher, il: is needless to say that: the present 
invention includes a case where the supplied program 
code is once stored in a memory provided in a function 
expansion board inserted in the computer or a function 
5 expansion unit connected to the computer, and then a 
CPU or the like provided in the function expansion 
board or the function expansion unit performs all or a 
part of the actual processes based on instructions of 
the program code, whereby the functions of the 
H 10 abovementioned embodiments are achieved by such the 

processes, 

Ui Although the present invention has been explained 

03 with the preferred embodiments, the present invention 

= is not limited to them. Namely, it is obvious that 

nj 15 various modifications and changes are possible in the 

Q% present invention without departing from the spirit and 

scope of the appended claims . 



